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Abstract. We revisit the problem of how spin- glasses "heal" after being exposed to 
tortuous perturbations by the temperature/bond chaos effects in temperature/bond 
cycling protocols. Revised scaling arguments suggest the amplitude of the order 
parameter within ghost domains recovers very slowly as compared with the rate it 
is reduced by the strong perturbations. The parallel evolution of the order parameter 
and the size of the ghost domains can be examined in simulations and experiments by 
measurements of a memory auto-correlation function which exhibits a "memory peak" 
at the time scale of the age imprinted in the ghost domains. These expectations are 
confirmed by Monte Cairo simulations of an Edwards- Anderson Ising spin-glass model. 



PACS numbers: 74.60.Ge, 02.50.Ey, 75.50.Lk 
1. Introduction 

A class of scaling theories PU El dj for randomly frustrated glassy systems has pointed out 
a striking fragility of their free-energy landscapes. While they realize some glassy order 
within a given environment specified for instance by temperature, even an infinitesimal 
change of the latter lead to radical reformation of the free-energy landscape to a 
globally uncorrelated new one. Such non-perturbative, global shuffling of the free- 
energy landscape with infinitesimal changes of control parameters are called as chaos 
effects. Indeed theoretical studies of some microscopic models including studies on 
Edwards-Anderson (EA) Ising spin-glass models by Migdal-Kadanoff renormzalization 
group (MKRG) method jlj E] and mean-field theory j7j (and references there in) and 
directed polymers in random media (DPRM) 8] have partially or almost fully confirmed 
such striking effects. Further works may clarify to what extent these unusual phenomena 
are universal. 

A natural interest is to see how slowly relaxing or aging glassy systems will react 
to such tortuous perturbations [5J EH HU H2 EE El • While systems like simple phase 
separating systems would either keep aging accumulatively (domain growth) or stop 
aging under external driving forces (e.g. stirring oil+ vinegar) ^5], spin-glasses exhibit 
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rejuvenation- memory effects [H] which are far more puzzling and richer. In jT2] a minimal 
description for such a dynamics was obtained for the case of Ising spin-glasses in terms 
of ghost domains, which is a direct extension of the concept of the standard scaling 
theory for domain growth m isothermal aging. In contrast to isothermal aging, the 
amplitudes of the order parameters or bias within domains become dynamical variables 
which play a central role: they act as internal driving forces which perturb the trajectory 
of the domain growth itself. As the result a concrete mechanism of imprinting/ retrieving 
multiple memory under the tortuous chaos effects was found. Recently the MKRG 
method was applied to the dynamics of the EA model subjected to chaos effects and 
such a mechanism was demonstrated explicitly. ^3] 

In the present paper we revise the ghost domain scenario based on the theory 
by Bray and Kisner pjj on the growth of the bias during domain growth dynamics. 
We consider a simplest one-step "perturbation-healing" protocol. An example is the 
one-step temperature-cycling protocol [THJ EH] first used in spin-glasses. It proceeds as 
follows. 

(1) Initial aging stage. First a spin-glass is equilibrated at a high enough temperature 
above the glass transition temperature T g . Then at time t = the temperature 
is quenched down to a temperature say Ta below T g where the system is aged for 
some time t w . This stage is just the same as usual isothermal aging. 

(2) Perturbation stage. The temperature is changed to Tg = Ta + AT (with AT being 
either positive or negative) where the system is aged for some time r p . Strong restart 
of aging or rejuvenation is observed, for instance, by measuring the AC magnetic 
susceptibility in the spin-glasses and ceramic superconductors [2Ql ETJ . Other glassy 
systems such as super cooled liquids [22], polymer glasses [2Bj exhibit no or much 
weaker rejuvenations. It may suggest absence of chaos effects in some classes of 
glassy systems. One should also keep in mind that large enough length/time scales 
compared with the overlap length (See Eq. 0) must be explored to see chaos 
effects. Failures of some experiments and simulations to detect rejuvenations may 
be related to this difficulty 

(3) Healing stage. Finally the temperature is put back to Ta- In spin-glasses strong 
restart of aging or rejuvenation is observed again [TJ3I2I1E]- After some recovery 
time say r rcc this restarted process disappears and the rest of the relaxation becomes 
a continuation of the initial aging stage, which is called the memory effect. We 
closely discuss the two stage processes in the healing stage based on the ghost 
domain scenario. 

Many systems "heal" by waiting some recovery time r rec after being exposed to a 
perturbation for a certain time r p . Simple minded "length scale (s)" (or some equivalent 
"energy-barrier") arguments which neglect the internal driving due to the remanent 
bias may lead to two contradictory possibilities: A) healing is impossible after such 
strong perturbations due to chaos effects or that B) healing is somehow possible and 
the recovery time r rec is just identical to the time scale at which the length scale T(r rec ) 
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(energy barrier) explored after switching off the perturbation becomes as large as the 
length scale L(t p ) (energy barrier) explored during the perturbation. Furthermore one 
could argue the "effective age" of the system imprinted in the system would be largely 
modified once L(t p ) becomes larger than the length (energy) scale corresponding to 
the age. Somewhat surprisingly we find that all these intuitions fail in general for the 
perturbations operated in the strongly perturbed regime of the chaos effect. In the 
present paper we also consider dynamics operated in the weakly perturbed regime of 
the chaos effect. This allows us to take into account effects of slowness of the switching 
on/off perturbations in realistic circumstances. 

After introducing the spin-glass model in the next section, the definition of ghost 
domains is summarized and the scaling theory by Bray and Kisner is briefly reviewed in 
section El In sections 0] and El the revised ghost domain scenario is introduced focusing 
on the simple one-step perturbation-healing protocol mentioned above and the scenario 
is examined numerically on the 4 dimensional EA Ising spin-glass model. In section 
El we propose a simple way to take into account the effects of slow switchings such as 
heating/cooling rate effects. The conclusion of the paper is presented in the last section. 



Specifically we consider the Edwards-Anderson (EA) Ising spin-glass models described 
by a Hamiltonian 



where <S$ is an Ising spin at site % located at fi on a d dimensional lattice with N lattice 
sites and J^ is a random interaction bond which takes +J and — J randomly for each 
nearest neighbor pair Here J > is the unit of energy scale. For convenience we 

denote the scaled thermal energy k^T/J as temperature T in the following. Here k-& 
is the Boltzmann's constant. We consider two kinds of perturbations, (1) temperature 
changes T — > T + AT; (2) bond changes J — > J' . A new set of bonds J' = {J'ij} 
is created from the original one J = {Jij} as follows. For each pair we choose 
J[a = —J^ randomly with probability p and JL = Jij with probability 1 — p. 

In the numerical simulation presented in section El we use the d = 4 model on 
the hyper-cubic lattice and the single spin flip heat-bath Monte Cairo method. In 
simulations we limit ourselves to bond changes since computational power is too limited 
to study temperature changes efficiently 

3. Ghost domains 

Let us introduce basic ingredients of the ghost domain scenario to prepare for the 
discussion of the simple one-step perturbation-healing protocol (e. g. the one-step 
temperature-cycling experiments) in the next two sections. For simplicity we assume 
that an equilibrium states Y T,J of a spin-glass a system with a set of random interaction 
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bonds J at temperature T below the spin-glass transition temperature T g is given 
by its typical spin configuration. Such a configuration at site i may be described as 
v / Q , EA(r)o" i ' where a i ' is an Ising variable and qEA(T) is the Edwards- Anderson 
(EA) order parameter which takes into account the effects of thermal fluctuations. 
Furthermore we assume the only possible other phase at same environment (T, J) is 
T T ' J whose configuration is given by —^/q E \(T)aJ ,J . However extensions to the cases 
that more phases exist for a given environment may be considered as well. 

3.1. Weakly and strongly perturbed regimes of chaos effects 

The chaos effects become stronger at larger length scales. Since the distinction between 
the weakly and strongly perturbed regimes are important in the following here we 
summarize the picture on the crossover between the two regimes given in [51 12*51 fT*"] . 

Let us consider a generic perturbation which may induce a droplet excitation of size 
L with respect to the "ground state" The excited state has a certain free-energy 

gap Fl(> 0) with respect to the ground state. Suppose that we have a perturbation such 
that the excited state obtains a gain of the free-energy of order AUl/J = b~{L/ Lo) a . Here 
L is a microscopic unit length scale. Then a droplet excitation will be induced if AUl 
turns out to be greater than the free-energy gap Fl- The free-energy gap is expected 
to have a broad distribution characterized by a distribution function Pl{Fl) with the 
scaling form PE|, p L (F L )dF L = p(F L / J(L/ L ) e )dF L / J(L/ L ) e where J(L/L ) e is the 
typical free-energy gap with 6(> 0) being the stiffness exponent . Using these properties 
the probability Pl(8) that a perturbation of strength 5 induces a droplet excitation of 
size L is found as 

r AU L r wm) ( 

p L (5) ~ / dF L p(F L ) = / dyp(y) (2) 

Jo Jo 

where 

aS) = LoS-W (3) 

is the characteristic crossover length, called overlap length, beyond which Pl(S) becomes 
0(1). The exponent (, the so called chaos exponent, is given by ( = a — 9. One can see 
that if ( > (a > 6) the probability pl {S) continuously increases with increasing L/£(6). 
In the following we distinguish between the strongly perturbed regime L/£(5) > 1 and 
the weakly perturbed regime L/£(5) < 1. 

In the strongly perturbed regime L/^{5) > 1, the original ground state {o~J^} is 
completely unstable with respect to the droplet excitations, i.e. a new equilibrium state 
must form. The term chaos [TJ 123 E] properly describes the fact that a strongly 
perturbed regime eventually emerge even for arbitrary small 5 1 at sufficiently large 
length scales. However, chaos does not set in abruptly at the overlap length £(5) but, 
in the weakly perturbed regime L/£(5) < 1 chaos like droplet excitations already occur 
at length scales smaller than £(5) with non-zero probability Pl(S) 0123 EH]- 

In the case of temperature shifts of strength AT the possible free-energy gain 
of a droplet excitation of size L is the entropy gain (xAT) which is expected to 
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scales as AUl/J ~ AT(L/ L ) ds ^ 2 where d s is the surface fractal dimension of droplet 
excitations. (See for a detailed discussion) In the case of bond perturbations, the 
random gain of energy of a droplet excitation happen at around its surface so that 
AUi/J ~ p(L/ L ) ds / 2 . Thus temperature and bond perturbations should lead to a 
chaos effect of the same universality class with ( = d s /2 — 9. 

3.2. Definition of ghost domains 

Let us consider a generic protocol such the working environment is changed from time 
to time among a set of target environments {A, B,...} which consists of different 
temperatures {Ta,T b , . . .} (all below T g ) and/or different bonds {Ja,Jb, ■ ■ •} whose 
equilibrium states are represented by ^/qEpjT^jaf, y/qEpjTB)crf ■, 

Suppose that the system is now evolving in a certain working environment, say 
W = (T w , J w ) at a certain time t. Short time averages may be took to average out short 
time thermal fluctuations. Then the temporal spin configuration can be represented as 
y/qmJTw)si{t) where Si{t) takes Ising values. It can be projected onto the equilibrium 
states of any environment R & {A, B, . . .} as 

Sf (t) = aS(t). (4) 

Then the projected image sf (t) is described in a coarse-grained way by the following 
two features. 

(i) the domain wall configuration: configuration of the spatial pattern of the sign of 
the projection sf (£). 

(ii) the order parameter, the amplitude of the projection p R (t) = | [s R (t)} domain | where 
[■ • ^domain denote the spatial average within a ghost domain. 

It is useful to consider decomposition of a ghost domain T R (T R ) into "patches" , 

• The strength of the bias has the full amplitude 1 within a patch. 

• The "signs +/— " of the bias is however different on different patches-the majority 
has the same sign as that of the ghost domain to which they belong to. Minorities 
have the opposite sign. 

The probability p m i n0 r(^) that a patch belongs to the minority phase T R (T R ) in a ghost 
domain of T R (T R ) is related to the strength of the bias p R (t) as 

Pminor(t) = (1 ~ p R (t))/2. (5) 

If one chooses R = W, a ghost domain reduces to an ordinary domain which 
is enough in isothermal aging where the order parameter is a constant. In the cycling 
protocols, minimal description is to keep track of projections on to the equilibrium states 
of all target environments. We call such projections as ghost domains. Very important 
point is that not only (i) the domain wall structures but also (ii) the amplitude of the 
order parameter within the domains are dynamical variables. 
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3.3. Physical observable 

Let us note here that basic quantities measured in experiments and simulations are 
essentially gauge invariant (or ghost invariant), i. e. they do not depend on specific 
choice of projections. An important example is the spin auto-correlation function 

C(t,t') = (1/N) < SMSiit 1 ) > (6) 

i 

where N is the number spins and < . . . > represents taking an averages over different 
trajectories. The auto-correlation function can be re-expressed in terms of any projection 
field sf(t) as C(t,t') = qEix(T R )(l/N) J2i < sf(t)sf(t') > because of = ±1. Thus 
it does not depend explicitly on the specific choice of projections, i.e. gauge invariant 
except for the prepfactor. The auto-correlation function can be measured experimentally 
by monitoring spontaneous thermal fluctuations of the magnetization M(t) [2TJ because 
the leading O(N) part of the magnetic auto-correlation function is NC(t,t') in spin- 
glasses with no ferromagnetic or anti-ferromagnetic bias in the distribution of the 
bonds. In experiments linear magnetic susceptibilities to uniform external magnetic 
field are often measured. By the same token as above it can be seen that the linear 
magnetic response functions (per spin) of spin-glasses to a uniform external field h(t'), 
R(t,t') = (1/N)d < M{t) > /dh(t') is essentially gauge- invariant. 



3.4- Basic dynamics at a working environment 

Suppose that the system is temporally evolving at a certain working environment W 
with temperature T = Tw with a certain set of bonds Jw- Here we summarize basic 
properties of the dynamics of the (ghost) domains of T w /T w . 

At coarse-grained mesoscopic level, the relaxational dynamics is considered as a 
thermally activated process of a droplet like excitation. The energy barrier associated 
with a droplet of size L scales as E h ~ A(T)(L/L )^ with ip > 0. Thus at a given 
logarithmic time scale log(t/r (T)) a droplet as large as 

L T (t) ~ L [(k B T/A(T)) ln(t/7b(r))]V* (?) 

can be thermally activated [213 • ^ n the above formula the effects of critical fluctuations 
can be took into account in a renormalized way in the characteristic energy scale A(T) 
for the free-energy barrier and the characteristic time scale Tq(T). 

Suppose that the projection of the initial spin configuration onto the equilibrium 
state Y w at time t = is strongly disordered such that its spatial correlation function 
decays rapidly beyond some correlation length £ ini , 



[( s T(o)-p iy (o))( s T(o)- P ^(o))] 



[3?(0)]=P W (P) (8) 
Here [. . .] denotes the average over space and F(x) is a certain rapidly decreasing 
function. Note that the bias p w (0) is made homogeneous within the system. 
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Domain growth without bias- If the initial bias is absent p w {0) = 0, the global 
Z 2 symmetry of the system is not broken and the domain growth (aging) never stops. 
The mean separation between the domain walls at time t is Lx{t) given in Eq. [26J. 
In such a critical quench the spatial correlation function 

C w (r,t,t') = [< sY(t)sf(t') >] H ^| (9) 

exhibits universal scaling properties PB]. In the so called aging regime Lx(t) > Lr(tf) 
it scales as 

^'K^Pfe) L ^> L ^- < 10 > 

The subscript "0" is meant to emphasize that the spin configuration is random at t = 
with respect to the target equilibrium state. Here h(x) is a decreasing function with 
h(0) = 1. The exponent A is a non-equilibrium dynamical exponent introduced by 
Fisher- Huse in [26 . (Note that in some literatures e.g. Refs (and also O I2H] ) A 
is denoted as A. In the present paper we follow [El HH] and use A for the decay of the 
correlation function and A for the growth of bias discussed below (See Eq. (JHJ)).) 

A special case of much interest is the auto-correlation function (r = 0) which is just 
the spin auto-correlation function C(t,t') defined in Eq. © which is a gauge invariant 
quantity. It generically follows a scaling of the form Co(t,t') = Co (Lt(*)/-^t (*'))• The 
scaling function Cq(x) remains at 1 in the quasi-equilibrium regime x < 1. In the aging 
regime x > 1, it approaches asymptotically as C (x) ~ x~ x . In Ising spin glasses 

d/2<\<d (11) 

is proposed [26 . This very slow relaxation is in sharp contrast to the exponential decay 
in the paramagnetic phase C (t, t') oc exp(— \t— t'\/r cq (T)) where r eq (T) is the correlation 
time in the paramagnetic phase. 

Domain growth with bias- Even if the initial bias p w {0) is small, the Z 2 
symmetry is explicitly broken if it is non-zero. One expects that the strength of the 
symmetry breaking will increase with time and eventually terminates the aging just as if 
external symmetry breaking field is applied. This problem was considered theoretically 
first by Bray and Kisner . They noticed that the non-zero homogeneous bias grows 
with time t as as 

P w (t)~p w (o)(^y (12) 

and the dynamical exponent A is related to A as 

\ + \ = d (13) 

Here let us summarize the derivation ^7] within our context. First one can see that 
the bias is nothing but the k = component of the Fourier transform of . Then 
one assumes that the amplitude of the k = component at time t can be computed 
as a linear-response to the change of its initial value. Second assuming the Gaussian 
characteristics of the random initial condition Eq. (JBJ) one finds the linear response 
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function is the same as the k = component of the spin correlation function Eq. ® up 
to some proportionality constant c. As the result one obtains 

p w (t) = cp w (0)C k=o (t,0) (14) 

Then using Eq. @ one finds Eq. (fT2"|) and Eq. (|13p. Combining the scaling relation 
Eq. (fT3J) and the inequality Eq. (JTTJ) one finds 

A/A > 1. (15) 

As we discuss below this inequality suggests healing of spin-glasses after chaotic 
perturbations takes an enormously long time. 



4. A cycle on a globally symmetry broken state 

Let us now begin with the perturbation-healing protocol by considering an idealized 
limit. This corresponds for example to the one-step temperature-cycling experiments 
mentioned in the introduction Ta —>■ Tb — » Ta but with the initial aging done for an 
extremely long time t w = 00: the spin configuration is globally equilibrated with respect 
to an equilibrium state T A at the beginning. Then perturbation is performed - change 
temperature or bond and let the system evolve for a certain time r v so that domains 
of r s /r s grow. Lastly healing is performed - switch off the perturbation and let the 
system evolve after wards for some time r^. Here A and B would stand for (1) Ta and 
Tb = Ta + AT in the case of temperature-cycling or (2) J a and Jb (which is created 
by randomly changing the sign of a fraction p of the bonds in the original set Ja) i n the 
case of bond-cycling. For simplicity we assume the switchings are instantaneous. The 
effects of slow switching times, e.g. finite heating/cooling rates, will be discussed later 
in sectional 

Strongly perturbed regime-If the duration of the perturbation r p is long enough 
such that L B ij p ) > £(<5), where £(£) is the overlap length given in Eq. Q and 5 can 
be either AT or p, the strongly perturbed regime of the chaos effects (see section IH.ljl 
should come into play. For simplicity here we neglect dynamics at short time scales 
which belong to the weakly perturbed regime. An extreme example of £(<5) = 1 is 
shown in Fig fusing a Monte Cairo simulation of a 2-dimensional Ising Mattis model. 

The initial spin configuration is globally aligned to T A so that it is fully biased as 
sf = 1. But simultaneously sf is completely disordered (beyond £(£)) with no bias 
[< sf >] = 0. Thus during the perturbation stage, the domains of both T B /T B grow 
competing with each other just as the usual domain growth. Their typical size becomes 
L b (t p ). As can be seen in the Figure [TJ this amounts to reduction of the bias (or 
staggard magnetization) with respect to T A . The remanent bias pf em becomes 

pin(Tp) = (l/N)J2~st(r P ) = (1/AO l>t(0)sf (r P ) = (l/N)J2~sf(0)sf(r P ) 

i i i 

= C (T p ,0)~(L B (r p )/mr X - (16) 
Here we used the properties of the initial condition and the gauge invariance of the auto- 
correlation function. The subscript "0" is used in the last equation because the initial 
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condition is completely random with respect to the relaxational dynamics which is at 
work during the perturbation. Here it can be seen clearly that the strong perturbation 
due to the chaos effect is not equivalent to put a system to a paramagnetic phase. In the 
latter case one would find exponential decay of the bias pf em (r p ) ~ exp(— T p /r cq (T B )) 
where r eq (TB) is the relaxation time in the paramagnetic phase. Thus chaos effect do 
not amount pushing the system to the disordered phase contrary to what might have 
been suspected. 

During the healing stage, the domains of both T A /T A grow competing with each 
other starting from the minimum length scale Their typical size becomes L^t^). 
However this is a domain growth with biased initial condition as Eq. (JHJ). From Eq. (fT2|) 




Figure 1. Evolution of ghost domains in a simple "perturbation- healing" protocol on 
a globally symmetry broken state. This is a demonstration using a heat-bath Monte 
Cairo simulation of 2-dim Ising Mattis model (N — 400 x 400) in which the interaction 
bonds in Eq. JQl are given as Jij = JoiOj where Oi is a random Ising (gauge) variables 
given at each site. One immediately finds the equilibrium state (ground state) for 
each J is simply given by the set {ci}. The initial spin configuration is chosen to be 
identical to a random ground state a A . Perturbation: For time t p — 100 (MCS) 
the system is strongly perturbed by using the Hamiltonian of a different ground state 
<j B which is completely uncorrelated with a A : £(<5) = 1 in the unit lattice. Healing: 
Then the Hamiltonian is put back to the original one which is used for additional 1000 
(MCS). In the present examples temperature is set to T = 2.0. The different colors 
(greycales) represent the sign + and — of the projections on to the ground states. 
The 3 columns on the left sides are snapshots at time 0, 10, 100 (MCS) during the 
perturbation. Domains of T B /T B grow while the bias p A decreases. In this example 
p A has become 0.03 which is too small to distinguish by eye. In the 3 columns on 
the right arc snapshots at time 10, 100, 1000 (MCS) during the healing. Here domains 
of T A /T A grow but the minority phase f A slowly disappears and p A increases. The 
recovery of the p A turns out to be much longer time than r p . In this model the 
growth law Eq. J7J) should be replaced by L(t)/Lo ~ \ftJto since it is equivalent to 
the ferromagnetic Ising model |16|. We found numerically A ~ 0.8 and A ~ 1.2 in this 
model being consistent with Eq. (fH^ 
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(17) 



where p A em is the remanent bias at the end of the perturbation stage (or the beginning 
of the healing stage). Note that Prec( r h) is proportional to the initial remanent bias 
p A m which is the direct consequence of the "linear-response' of the temporal bias with 
respect to the change of the initial bias as noticed by Bray and Kisner. 

The above situations may be rephrased as the following. During the perturbation 
stage the system may be decomposed into patches whose size is given by the overlap 
length £(5). The probability p m inor that a patch belong to the minority phase T A is 
related to the bias p A as given in Eq. (JHJ so that it increases with r p during the 
perturbation stage. Next in the healing stage the system may be decomposed into 
patches of size L^(rh), which now grows with r h . The probability p m i nor now decreases 
because p A increases. Consequently the minority phase eventually disappears and the 
domain growth stops at the recovery time r rec . 

Combining Eq. (fTH|) and Eq. (|T7j) one finds the recovery time T^l° ng of the strength 
of the bias as 



Here the super-script "strong" is mean to emphasize that it is a formula valid in the 
strongly perturbed regime. Since A/A > 1 as given in Eq. (|15p. we conclude that the 
recovery time can be significantly large. j2Hj 

The above considerations can be extended to multi-step cycling. Very counter- 
intuitive consequences follow due to multiplicative nature of the effect of multiple 
perturbations [T2] . For example another perturbation stage to grow T c /T c for some 
time Tp can be added before the healing stage in the perturbation-healing protocol 
discussed above. Here T c is assumed to be decorrelated with respect to both T A and Y B 
beyond the overlap length £(5). Then the recovery time r^l° ng of the order parameter 
of A becomes, 



which can yield huge recovery time. 

Weakly perturbed regime- If the duration of the perturbation t p is small such 
that Lb < £(<5), the effect of the perturbation should remain mild as explained in section 
13.11 Here the mutual interferences between ghost domains just amount to induce rare 
droplet excitations of various size L with probability Pl{o~) <C 1 (see Eq. (J2J)) on top 
of each other. They are just independent islands of the minority phase which rarely 
overlap with each other. Thus one only needs to keep track of switch on/off of such 
isolated objects during perturbation and healing stages. This means a naive "length 
scale(s)" argument to estimate the recovery time of bias fortunately do not fail in this 
regime. 




(18) 




(19) 
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More precisely the result of implies the remanent bias decreases due to the 
increase of rare islands of the minority phase as 

P>L(t p ) = 1 - cp LM {8) + 0(p 2 ) ~ 1 - c(L B (T p )/a5)) ( (20) 

in the perturbation stage and increases as 

pi(r h ) = Prcm (r p ) + c(L A (r h )/^)) C (21) 

by removing islands one by one in the healing stage. Here c is some numerical constant. 
We have neglected higher order terms of 0(p 2 ). In the MKRG analysis [13] . it has been 
shown that both Eq. (]20|) and Eq. (|T6|) are limiting behaviors of a universal scaling 
function of of Lb/ £(5). Note that the bias recovers in additive fashion in Eq. fl21(l which 
is markedly different from the multiplicative fashion found in the strongly perturbed 
regime Eq. ([T7|). 

One finds the recovery time in the weakly perturbed regime is simply given as 

L A (rZT k ) = L B (r p ) or r^; k /r {T A ) = (t / y ( TB ))(A(^)/A(T B ))(T B /t a ) (22) 

Here the super-script "weak" is mean to emphasize that it is a formula valid only in 
the weakly perturbed regime. The 2nd equation holds in the case of activated dynamics 
Eq. which simplifies further at low enough temperature as T r ^ ak /r = (t/r ) ( - Ts//TA ^ 
where temperature dependence of the unit time r (T) and the energy scale A(T) can be 
neglected. There one only needs to know the microscopic time scale tq, which is known 
to be around 10~ 12 — 10 -13 (sec) in real spin-glass materials, to estimate the recovery 
time r r ^ ak . 

Moreover it is easy to see that non-overlapping islands of the minority phase cannot 
cause any non-trivial effect of multiple perturbations (see Eq. ([19])). This point becomes 
important when we consider the effects of slow switching, e. g. heating/cooling rate 
effects in section [HI 

Other non-chaotic, mild effects of perturbations can be considered in similar ways. 
For instance change of thermally active droplets can be took into account by changing 
Pl{8) above by AT/(L/L ) e . The latter amounts to an even weaker effect at larger time 
scales but may be dominant at short time scales. 



5. Parallel evolution of domain sizes and order parameter 

Let us complete the scenario for the one-step perturbation-healing protocol by now 
allowing the waiting time t w in the initial aging to be finite. Suppose the system is 
completely disordered with respect to both T A and T B at the beginning and aged for 
some waiting time t w at A. Then instead of an infinitely large domain of T A , there will 
be domains of T A and T A of size (&»■)■ in the following we consider the perturbation- 
healing protocol exerted onto this initial state. 

The time evolution of the system in a cycling protocol can be concisely described 
by the time evolution of the ghost domains of T A /T A and T B /T B . ^2] The situation 
may be visualized again simply by patches. A ghost domain T A of size L^(t w ) may 
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be decomposed into patches of size £(5) during perturbation stage and patches of size 
La{t)x) during healing stage. Within a patch the bias is always homogeneous and has 
the full amplitude 1. But the "signs" of the bias is different on different patches. The 
probability p m i nor (Eq. ©) that a patch belong to the minority phase T A increases with 
time as Eq. ([TBI in the perturbation stage and decreases as Eq. (fTTjl in the healing stage. 
Since the size of the ghost domain itself is finite, it also continues to grow during the 
healing stage. Following ^2] we call the new domain growth under the background bias 
field during the healing as inner- coarsening and the further growth of the size of the 
ghost domain itself as outer-coarsening. 

The crucial point is that the projection s A keeps the same long wavelength 
spatial structure of sign of the bias as the original domain structure just before the 
perturbation throughout the perturbation-healing stages. In the absence of such an 
explicit mechanism of a sort of symmetry breaking, the new domains grown during the 
healing would have completely wrong signs of bias and could lead to total erasure of the 
memory. (The scenario (A) mentioned in the introduction.) The latter was the main 
problem in the previous attempt to model multiple domains by Koper and Hilhorst 
[3T)j and many other popular "length scale (s)" arguments which neglect the role of the 
internal driving by the remanent bias. 

5.1. Memory correlation function 

The memory of the "state" of the system just before the perturbation (or the end of the 
initial aging stagey) can be directly quantified by the spin auto-correlation function as, 

Cmem(' r + ^W; ^w) = C (t + t w , t w ) . (23) 

which we call as memory correlation function. The hamming distance d — 1 — C mem 
gives a measure of the closeness in the phase space between the phase points at the 
two times. Note that in the limit t w — ► oo it reduces to the global bias p A discussed in 
section HJ It is useful to recall that the auto-correlation function is gauge invariant so 
that it is suitable for experiments/simulations of spin glass systems where one does not 
know a priori any equilibrium states below T g . 

Strongly perturbed regime- Let us first consider a cycling operated in the 
strongly perturbed regime. During the perturbation stage one can easily see C mem is 
identical to a/ <?ea(2~a)\/ ^ea^^Co^p, 0) where C (t p ,0) = p A m ( r p) 
(See Eq. 116)1 ) During the healing stage the analytical result of a spherical Mattis model 
suggest the following factorization (See Eq. (109) of [12]) 

Cmem(7h + T p + t w , t w ) = q EA (T A ) pf cc (T h ] pf em )C (T h + t w , t w ) . (24) 

Here the factor p A c (Th; p A m ) represents the growth of the bias within the ghost domains 
by the inner-coarsening (See Eq. (fT7))) and the factor C (rh + t w ,t w ) represents the 
outer-coarsening which is the auto-correlation function in isothermal aging (without 
perturbation r p = 0). Thus the memory correlation function Eq. ()24jl behaves non- 
monotonically with time in the healing stage and exhibits a peculiar "memory peak" 
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because of the two competing factors: p Tec (T h ) increases while C (r h + t w ,t w ) decreases 
with Th- 

In Figure we show the memory auto-correlation function of the 4 dim EA model 
after a bond perturbation of strength p = 0.2. By an independent numerical study of a 
bond-shift simulation done in the same way as in a recent temperature-shift experiment 
|1U[ 125] . we checked our time window lies almost entirely in the strongly perturbed 
regime with p = 0.2 as reported elsewhere [TI]. In the scaling plot (b), the expected 
multiplicative recovery of bias (memory) (See Eq. (fTTjl ) is demonstrated. 

In a previous study of this model j2H] A ~ 3.0 — 3.5 was found by analyzing the 
relaxation of thermo remanent magnetization (TRM). As shown in the scaling plot (b) 
the present result appear to be consistent with A ~ 0.8 and A ~ 3.2 (thus A/A ~ 4) 
being consistent with the scaling relation Eq. (fT3j) and the inequality A/A > 1 Eq. (fT5|) . 
Indeed it can be seen that the recovery time at which the data merges with the reference 
data of C (rh + t w ,t w ) (thus p A — > 1) is already as large as O(10 4 ) (MCS) even with 
very short perturbation r p = 10 (MCS). 

The factorization in Eq. (|2^|) strongly suggests independence of the evolution of the 
amplitude of the bias or the order parameter and size of the domain. Consequently 
somewhat surprisingly the above result suggest the memory peaks can be always 
identified no matter how long the perturbation is kept on. Note that nothing special 
happens when L(t p ) exceeds L{t w ). Only the amplitude of the signal will be smaller for 
longer perturbation so that higher resolution is required. 

Rather amusingly the factorization Eq. ()24)1 allows one to extract the growth of the 
amplitude of the bias p even with no knowledge of the underlying equilibrium state T/T 
thanks to the gauge (ghost) invariance of the auto-correlation functions. Probably it is 
interesting to apply the same trick to other spin-glass models. In d = 3 Ising EA model 
the data reported in [32] on the relaxation of the auto-correlation function in isothermal 
aging suggest roughly A ~ 2 and hence A/A ~ 2 assuming the scaling relation Eq. (fTTTf) . 

Weakly perturbed regime- Naturally the factorization of the time evolution of 
the bias and the size of the domains Eq. (|2*%|) should also hold in the weakly perturbed 
regime. In the 4 dim EA model we also performed bond cycling simulations operated 
in the weakly perturbed regime with very small p such as p = 0.02. There we found 
the recovery of the bias is additive as suggested by Eq. (j2H) and the recovery time was 
found to be the trivial one r rec ~ r p being consistent with Eq. (J2~2~j) . 

5.2. Magnetic susceptibilities 

In experiments AC/DC magnetic susceptibilities are often used to study dynamics of 
spin-glass materials. As noted in section 13.31 these are also essentially gauge invariant 
quantities. Here we discuss possible scaling properties of those in the healing stage. 

The relaxation of the AC susceptibility of frequency uj can be considered as a probe 
of the increase of the effective stiffness of a droplet excitation of size Lt(1/uj) due to 
decrease of domain wall density. The scaling ansatz which follows this picture has 
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been supported by recent numerical and experimental studies j^Sl EH EH1 12H1- In the 
healing stage, there must be excess contributions from the domain walls around the 
islands of the minority phase. A given spin can be surrounded by such a wall with 
probability p min or(T"h, r p ) = (1 - p roc (r h , p rom Op))) (See Eq. ©) which increases with r p 
and decreases with r^. Then a natural scaling is 

X"(UJ, T h +T p +t w ) = PminorOh! T p )x'o(u , T h )+Xo(u, T h +t w ) for Pminor < 1 

Here x'oi^^t) is the AC susceptibility of isothermal aging starting from random initial 
condition at t — 0. The 1st term is the excess response due to the minority phase. 
Since p m inor( r h) T P ) decreases with time Th, the excess part slowly fades away. The 2nd 
term in the r.h.s.is due to the outer-coarsening which is just the AC susceptibility 
without perturbation. If the cycling is operated in the weakly perturbed regime, the 
excess part will fade away at the time scale r r ^ ak given in Eq. (f""2~j) while it will take 
an extremely long time r r S g™ ng given in Eq. (j!8)l in the strongly perturbed regime. It is 
interesting to note that anomalously large recovery time which apparently exceeds the 
simple estimate Eq. (f2~""") . which is valid only in the perturbative regime, has been found 
in recent measurements of the AC susceptibility [2*4*1 

In isothermal aging which start from a random initial condition at t — the ZFC 
susceptibility Mzfc( t = t — t w ) measured under a probing field switched on after waiting 
time t w exhibits a rapid increase at around r ~ t w . The latter is reflected as a peak of 
the relaxation rate S(t) = dS(T)/d\og(r) at around r ~ t w . [36J In the cycling operated 
in the strongly perturbed regime, it is very likely to happen that the population of the 
minority phase within the ghost domains p m mor(Th) remains non-zero at the time scale 
Th ~ t w . This may explain the substantial reduction of the amplitude of the memory 
peak of S(r h ) at around r h ~ t w in one-step temperature-cycling experiments operated 
in the strongly perturbed regime [""7| ITTj. 

6. Renormzalization of slow switching effects 

So far we considered idealized situations that perturbations are switched on/off 
instantaneously which is not possible in reality. For example typically heating/cooling 
rates are Vt — 1 Kelvin/second in "quench" experiments fH] which is equivalent to 
vt = 10~ 15 J/MCS in simulations (assuming T g = 10 K and the microscopic time scale 
t = 1CT 13 (sec)). The surprising weakness of heating/cooling rate effect in spin-glasses 
[*"] already suggests relevance of the chaos effects. 

Let us illustrate here some important consequences of such a slow switching by 
considering a continuous bond change protocol as an example. Suppose that the signs 
of a fraction p of ± J bonds in a temporally set J{t) are changed randomly in a unit time 
To. After some transients the system should become stationary by the chaos effect such 
that the size of the ghost domains of becomes constant in time L VJ which decreases 
by increasing the bond change rate v j = pJ/tq. Then we can consider for example a one- 
step bond cycling J^w) - ► ^b( t p) "~ * ^(^h) with such a gradual bond changes. The 
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point is that at length scales smaller than L VJ the whole cycling process just amounts to 
successive operations in the weakly perturbed regime. There the multiplicative effects 
Eq. ()19j) are avoided as explained in section ETT1 Then the cycling can be coarse-grained 
by taking L VJ as the new microscopic length scale instead of the overlap length £(5) 
between A and B which yields a coarse-grained cycling Ja^Jb^ J a operated in a 
strongly perturbed regime with instantaneous bond changes. The scaling properties of 
the strongly perturbed regime will hold for the latter but the original overlap length 
£(<5) should be replaced by the renormalized overlap length L VJ , for example in Eq. 1)18)1 . 
which leads to a certain "rounding" of the strong chaos effects in realistic circumstances. 

Although the temperature dependence of the growth law Eq. (jZJ induce some 
obvious complications, essentially the same argument for the case of continuous 
temperature changes leads to a corresponding renormalized overlap length L VT which 
decreases with increasing heating/cooling rate vt- 

7. Conclusion 

To summarize we studied how spin-glasses heal after being exposed to strong 
perturbations which induce the chaos effects in simple perturbation-healing protocols 
(e.g. one-step temperature-cycling). The bias or the order parameter within the ghost 
domains decays as L~ x in the perturbation stage and increases as L x in the healing 
stage with increasing dynamical length scales L. The inequality of the exponents A > A 
immediately suggests anomalously large recovery times of the order parameter. The 
memory auto-correlation function is suited for direct examination of the time evolution 
of the order parameter. It should exhibit the memory peak in the healing stage at the 
time scale of the "age" imprinted in the ghost domains due to the parallel evolution 
of the order parameter (inner-coarsening) and the size of the ghost domains (outer- 
coarsening). The predictions were checked quantitatively by numerical simulations in 
the 4 dim EA model. It should be very interesting to measure experimentally the 
memory auto-correlation function by the noise-measurement technique [2Z1 for example 
in the standard one-step temperature-cycling protocol. Extensive experimental and 
numerical investigations which examine the ghost domain scenario in other observables 
such as the AC/DC magnetic susceptibilities will be reported elsewhere Jllj. Important 
features of the weakly perturbed regime of the chaos effect were also discussed which 
leads to a proposal to take into account the effect of finiteness of switching on/off the 
perturbations in experimental circumstances by the renormalized overlap length. 
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Figure 2. Memory correlation function of the 4 dim EA model. The perturbation 
is a bond perturbation of strength p = 0.2. The temperature is T — 1.2 (T g = 2.0). 
The system size is N = 24 4 which is large enough to avoid finite size effects within 
the present time window The initial waiting time is fixed as t w = 10 4 (MCS). (a) 
The data points labeled "perturbation stage" is C mcm (r p + t w ,t w ). Other data points 
are those in the healing stage C mcm (rh + r p + t w ,t w ) after various duration of the 
perturbation t p = 10, 10 2 , 10 3 , 10 4 , 10 5 (MCS) from the top to the bottom. Note that 
the last one is even larger than the initial waiting time t w . The solid line is the reference 
curve of CofVh +t w ,t w ) obtained by a simulation of isothermal aging with t w = 10 4 
(MCS). (b) The memory correlation functions scaled by the remanent bias p rem (r p ) are 
shown. The latter is directly read off from the data in the perturbation stage (shown 
in (a)) as yO r em(Tp) = C mem (r p + t w , t w ). Here the dynamical length £t=i.2(0 is used 
which has been obtained in a previous study of the same model [H2EE1- The straight 
lines are the power laws x x and x~ x with A = 0.8 and A = 3.2. 



